Jancik et al. Journal of Experimental & Clinical Cancer Research 2012, 31:79 
http://www.jeccr.eom/content/31/1 /79 




Journal of Experimental & 
Clinical Cancer Research 




A comparison of Direct sequencing, 
Pyrosequencing, High resolution melting analysis, 
TheraScreen DxS, and the K-ras StripAssay for 
detecting KRAS mutations in non small cell lung 
carcinomas 



Sylwia Jancik 11 , Jiri Drabek 1,2t , Jitka Berkovcova 1 , Yong Zhong Xu 3 , Marcela Stankova 1,4 , Jiri Klein 5 , Vitezslav Kolek 6 , 
Josef Skarda 7 , Tomas Tichy 7 , Ivona Grygarkova 6 , Danuta Radzioch 3 and Marian Hajduch 1,2 * 



Background: It is mandatory to confirm the absence of mutations in the KRAS gene before treating metastatic 
colorectal cancers with epidermal growth factor receptor inhibitors, and similar regulations are being considered for 
non-small cell lung carcinomas (NSCLC) and other tumor types. Routine diagnosis of KRAS mutations in NSCLC is 
challenging because of compromised quantity and quality of biological material. Although there are several 
methods available for detecting mutations in KRAS, there is little comparative data regarding their analytical 
performance, economic merits, and workflow parameters. 

Methods: We compared the specificity, sensitivity, cost, and working time of five methods using 131 frozen NSCLC 
tissue samples. We extracted genomic DNA from the samples and compared the performance of Sanger cycle 
sequencing, Pyrosequencing, High-resolution melting analysis (HRM), and the Conformite Europeenne (CE)-marked 
TheraScreen DxS and K-ras StripAssay kits. 

Results and conclusions: Our results demonstrate that TheraScreen DxS and the StripAssay, in that order, were 
most effective at diagnosing mutations in KRAS. However, there were still unsatisfactory disagreements between 
them for 6.1% of all samples tested. Despite this, our findings are likely to assist molecular biologists in making 
rational decisions when selecting a reliable, efficient, and cost-effective method for detecting KRAS mutations in 
heterogeneous clinical tumor samples. 
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Background 

At present, identifying targeted anticancer treatment 
suitable for a given patient requires the availability of ac- 
curate diagnostics. Diagnostic techniques therefore have 
a significant impact on patients' survival and quality of 
life [1]. In recent years, it has become apparent that cer- 
tain types of tumors undergo mutations that either ori- 
ginate from the aberrant physiology of the tumor or are 
induced/selected by mutagenic cancer therapies [2-4]. 
Failure to detect mutations in important regulatory 
genes in tumor specimens may have serious conse- 
quences for the patients, because these alterations can 
significantly reduce the effectiveness of certain biological 
and cytotoxic therapies. Mutations in the KRAS onco- 
gene are often found in human cancers. They are most 
common in pancreatic cancer, which can exhibit muta- 
tion rates of 80 - 90%. KRAS mutations are also 
observed in 40 - 50% of colorectal cancers and 10 - 30% 
of Non-Small Cell Lung Cancers (NSCLCs). 

Recent studies have shown that some anticancer 
drugs are only effective against tumors in which the 
KRAS signaling pathway has not undergone oncogenic 
activation. These include the small-molecule epidermal 
growth factor receptor inhibitors erlotinib (Tarceva®) 
and gefitinib (Iressa®), which are used to treat NSCLC 
patients, and monoclonal antibody therapies such as 
cetuximab (Erbitux®) and panitumumab (Vectibix®), 
which are primarily used in the treatment of metastatic 
colorectal cancers (mCRC) [5-7]. According to the U.S. 
National Comprehensive Cancer Network (NCCN) 
guidelines from November 2008 (http://www.nccn.org/ 
about/news/newsinfo.asp?NewsID=194) and recommen- 
dations of the American Society of Clinical Oncology 
(ASCO)[8], screening of the status of the KRAS gene is 
mandatory when deciding whether or not a patient with 
colorectal cancer should receive anti-EGFR drugs. Simi- 
lar rules are being considered for NSCLC where KRAS 
mutations have prognostic value for progressive disease 
in adenocarcinoma [9,10]. 

There are multiple methods for detecting KRAS muta- 
tions in patient tissues, with varying analytical parameters. 
Individual methods need to be evaluated in terms of their 
sensitivity, specificity, and cost per analysis before they 
can be considered to meet acceptable gold standards in 
clinical practice. A standardized European quality assur- 
ance program for tests to detect mutations in KRAS was 
proposed at the Third International Congress of Path- 
ology, held by the European Society of Pathology (ESP) in 
Barcelona in May 2008. This program is focused on 
achieving optimal accuracy and proficiency across the 
European Union [11]. However, there are many methods 
in current use, some of which are only employed by indi- 
vidual laboratories and are not commercially available. 
These typically include sequencing assays [12] and gel- 



based DNA conformation assays [13,14]. Some of the 
commercial assays for detecting mutations in the KRAS 
gene have not yet been validated for clinical use 
(i.e.: Allele-specific oligonucleotide hybridization - Invi- 
gene®, KRAS mutation test kit - EntroGen®). At the 
time of writing, only the TheraScreen® kit sold by Qia- 
Gen, the KRAS LightMix® kit sold by TIB MolBiol, and 
the K-ras StripAssay® sold by ViennaLab had received 
the Conformite Europeenne (CE) mark certifying them 
as being suitable for diagnostic use in the clinic under 
the terms of the European IVD Directive 98/79/EC. 

In order to assess the specificity, sensitivity, cost, and 
working time of five frequently used methods for detect- 
ing mutations in KRAS, we performed parallel tests 
using DNA extracted from 131 frozen NSCLC tissue 
samples. The methods examined were Sanger cycle se- 
quencing, Pyrosequencing, High-resolution melting ana- 
lysis (HRM), and the CE-marked TheraScreen DxS and 
K-ras StripAssay kits. Our data demonstrate that there 
are important differences between these methods, which 
should be considered in routine clinical testing for KRAS 
mutations. 

Methods 

Pathological assessment 

The experimental research presented in this manuscript 
was performed in compliance with the Helsinki Declar- 
ation according to the study ethics proposal approved by 
Ethical Board of Palacky University in Olomouc. Written 
informed consent was obtained from all patients for the 
use of the collected samples in the research projects 
which includes studies for publication of this report or 
any accompanied images. 

Diagnosis of NSCLC was initially performed at the 
time of surgery and later confirmed from leftover by 
histological subtyping performed by experienced path- 
ologist. All samples were found to contain more than 
70% of tumour cells from at least 200 cells. 

DNA extraction from cell lines and primary tumor 
samples 

Genomic DNA was extracted from 131 frozen Non 
Small Cell Lung Cancer (NSCLC) tissue specimens 
removed from patients undergoing surgery for lung can- 
cer. Tissue was snap frozen in liquid nitrogen immedi- 
ately after surgery and stored at -80°C until analyzed. 
Cell lines with specific KRAS mutations were obtained 
from the American Tissue Culture Collection (ATCC, 
Rockville, MA) and cultured according to ATCC instruc- 
tions. DNA extraction and purification was performed 
using the QIAquick (QIAGEN, Hilden, Germany) isolation 
kit according to manufacturer's instructions; in each case 
examined, the five methods were tested against the same 
DNA isolate, so potential differences in percentage of 
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tumor cells does not confound the method comparison. 
Concentrations of DNA samples were measured spectro- 
photometrically using a NanoDrop ND 1000 spectropho- 
tometer (NanoDropTechnologies, Wilmington, USA). 

Genotyping methods 

Analyses were performed according to a blinded design, in 
which the experimentalist was not aware of the KRAS mu- 
tation status of any given sample. 131 NSCLC samples 
were analyzed using four methods: Direct sequencing, 
Pyrosequencing, and the TheraScreen DxS and K-ras Stri- 
pAssay kits. Due to limited amount of tissue, only 116 
samples from this group were also subjected to HRM ana- 
lysis and 114 yielded usable data. Significance of the con- 
cordance of mutation detection with different methods for 
two categories (wildtype and mutant) was assessed by k 
statistics (http://faculty.vassar.edu/lowry/kappa.html). 

Direct sequencing method 

Two primers were used to prepare amplicons for use in 
Sanger dideoxy termination sequencing [15]: a forward 
(FW) primer, 5 AAA AGG TAC TGG TGG AGT ATT 
TGA, and a 3' reverse (REV) primer, 5' TCA TGA AAA 
TGG TCA GAG AAA CC 3' (Generi-Biotech, Hradec 
Kralove, Czech Republic). PCR was performed with a 
reaction volume of 50 ul in an MJ Research PTC-200 
Peltier Thermal Cycler (Watertown, USA). The compos- 
ition of the PCR reaction mixture was as follows: 
MgCl 2 (3 mM, ThermoScientific, Waltham, USA), dNTPs 
(0.2 mM, ThermoScientific), ThermoStart DNA polymer- 
ase (2U, ThermoScientific), FW-primer (0.3 uM), REV- 
primer (0.3 uM), lxPCR buffer, and between 10 ng and 
100 ng of genomic DNA per reaction. The following 
amplification program was used: 95°C/15 min to acti- 
vate the Taq polymerase; 35x (95°C/30 s, 58°C/30 s 
72°C/30 s) for denaturation, annealing, and extension; and 
finally 75°C/5 min to finalize the extension, followed by 
cooling to 15°C. The PCR product was separated using a 
2% agarose gel and purified using the QIAquick PCR puri- 
fication kit (QIAGEN, Hilden, Germany). For each sample 
specimen, separate sequencing reactions were performed 
using the forward (FW) and reverse (REV) primers. The 
sequencing primers were internal to the amplicons from 
the previous PCR cycles: FW - 5' TTA ACC TTA TGT 
GTG ACA TGT TCT AA 3', REV - 5' AGA ATG GTC 
CTG CAC CAG TAAT 3'. Sequencing reactions were per- 
formed according to the manufacturer's protocol in a 
20 ul reaction volume containing 4 ul DTCS Quick Start 
kit (Beckman Coulter, Brea, USA), 1 ul (10 uM) of the 
FW or REV primer, 10 ul nuclease-free water, and 5 ul 
of 25x diluted template PCR product. After cleaning, 
precipitated DNA was diluted in SLS-formamide 
(Beckman Coulter, Brea, USA) and dideoxylabelled frag- 
ments were size-separated using an automated CEQ 



8800 Genetic Analysis System (Beckman Coulter, Brea, 
USA) (Figure 1). Sequence identification was performed 
using version 1.42 of the Chromas software package 
(Conor McCarthy, Southport, Australia). For all analyses, 
data obtained with the forward and reverse primers were 
combined and aligned to the consensus sequence 
obtained from the BLAST GenBank database http:// 
www.ncbi.nlm.nih.gov/nuccore/166706780? 
report=genbank. 

Pyrosequencing 

In the pyrosequencing method for DNA sequence ana- 
lysis [16,17], inorganic phosphate released in the course 
of nucleotide incorporation serves as the initial substrate 
in a sequence of four successive enzymatic reactions. 
This result in the emission of light, which functions as a 
signal that is proportional to the number of nucleotides 
incorporated. 

In this project, the PyroMark K-ras assay test (Biotage, 
Uppsala, Sweden) was used for primary amplification 
and pyrosequencing of both the 12th and the 13th 
codons of the KRAS oncogene (Figure 2). The following 
amplification program was used: the mixture was heated 
at 95°C for 5 min, then subjected to 45 cycles of 95°C 
for 15 s, 57°C for 30 s, and 72°C for 15 s. It was then 
held at 72°C for 5 min, and finally cooled to and held at 
4°C. The final concentrations of the PCR components 
were: lx PCR buffer, 2 mM MgCl 2 , 0.125 mM dNTPs, 
0.2 uM FW primer and 0.2 uM REV biotinylated primer, 
1U of AmpliTaq polymerase (Perkin Elmer, Waltham, 
USA) and 2 ng/ul DNA template. Fifteen ul of the PCR 
product was run on a 1,5% agarose gel (Sigma-Aldrich, 
St. Louis, USA) to confirm successful amplification, and 
100 ng of PCR products were sent to the EpigenDX 
company (Worcester, USA) to be analyzed using the 
PyroMark MD System and the Pyromark ID analysis 
Software with previously validated cut-off of 5%. 

K-RAS TheraScreen DxS 

The TheraScreen DxS KRAS Mutation Kits KR-21 and 
KR-22 (QiaGen, Hilden, Germany) are designed to detect 
six mutations in codon 12 (Gly>Ala, Asp, Arg, Cys, Ser, 
and Val) and one in codon 13 (Gly>Asp) of the KRAS 
oncogene. The primers used in the assay have two charac- 
teristic features: sequence-specific 3' ends (which com- 
prise the PCR- Amplification Refractory Mutation System, 
PCR-ARMS®) to identify specific mutations, and Real- 
time PCR-Scorpion® primer tags, which fluoresce when 
incorporated into double-stranded DNA (Figure 3). 
The commercial test kit includes an internal reaction con- 
trol and a synthetic control template. The degree of muta- 
tion of KRAS is calculated on the basis of the difference 
between the control reaction and the allele-specific reac- 
tion in terms of the number of cycles required for the 
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Figure 1 Sequencing of the KRAS gene in DNA isolated from NSCLC tissues. (A) Wild type-(12Gly-GGT, 13Gly-GGC), (B) Mutant- (12Asp-GAD. 



fluorescence of the reaction mixture to exceed the back- 
ground level (A-C T ) [18]. 

PCR reactions were performed according to the pro- 
tocol recommended by the manufacturer (TheraScreen 
K-RAS Mutation Kit version DU001PE) using a LightCy- 
cler®480 II (Roche Applied Science, Penzberg, Germany), 
with a final reaction volume of 25 ul. An initial denatur- 
ation step at 95°C for 4 min was followed by 45 cycles of 
95°C for 30 sec and 60°C for 1 min. Analysis was 
performed using a predefined absolute quantification 
algorithm implemented in the LightCycler Analysis 
Software 1.5.0 SP3 program (Roche Applied Science, 
Penzberg, Germany) and by visual inspection conducted 
by two different researchers. 

K-ras StripAssay 

The K-ras StripAssay REF 5-590 (ViennaLab Diagnostics 
GmbH, Vienna, Austria) detects the 10 most common 
mutations in the KRAS gene by using multiplex mutant- 
enriched PCR and reverse-hybridization of the amplifica- 
tion products to nitrocellulose test strips (oligonucleotides 
used in the subsequent hybridization reactions are synthe- 
sized as probes targeting 8 mutations in codon 12 of the 
KRAS gene (Gly>Ala, Arg, Asp, Cys, He, Leu, Ser, and 



Val) and two mutations in codon 13 (Gly> Asp and Gly> 
Cys). Specifically hybridized biotinylated oligonucleotides 
are visualized using streptavidin-alkaline phosphatase and 
colored substrates (Figure 4). 

The KRAS StripAssay was performed according to the 
manufacturer s protocol (K-ras StripAssay™, ViennaLab 
Diagnostic GmbH, Vienna, Austria). Samples were diluted 
using deionized water to a concentration of 10 ng/ul. Five 
ul of diluted DNA was added to the multiplex PCR reac- 
tion with biotinylated primers, and PCR was conducted 
according to the manufacturers instructions. All of the 
incubation steps were performed using a PST-60 HL Plus 
thermoshaker (Biosan, Riga, Latvia) platform with the 
temperature set to 45°C. Scanning was performed using 
the EPSON Perfection V30 scanner (Epson America, Inc., 
Long Beach, USA) and bands were analyzed by StripAs- 
sayEvaluator software (ViennaLab, Vienna, Austria) and 
by visual inspection. 

High resolution melting analysis 

The high-resolution melting (HRM) assay is a platform 
for real time detection of mutations that can be used to 
identify small differences in DNA sequences, even in 
heterozygous samples, by assessing changes in the shape 
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Figure 2 Pyrosequencing of the KRAS gene in DNA isolated from NSCLC tissues. (A) Wild type-(12Gly-GGT, 13Gly-GGC), (B) Mutant-/GR4S 
(12Cys-TGT). 



of their melting curve profiles compared to profiles gen- 
erated using standard (wild-type) DNA [19] (Figure 5). 
The HRM assay was developed using a new family of 
DNA-intercalating dyes including SYTO 9, LC Green 
and LC Green PLUS+ that display strong intercalation and 
even association with DNA. 

HRM-PCR reaction components were used accord- 
ing to the instructions provided with the LightCycler® 
480 II (Roche) instrument. The LC Green PLUS (Idaho 
Technology, Salt Lake City, USA) intercalating dye was 
used, together with the primers FW-5'-AAA CTT 
GTG GTA GTT GGA GCT-3' (forward) and REV-5'- 
ATT AGC TGT ATC GTC AAG GCA-3' (reverse). 
The final concentrations of the components of the re- 
action mixture were: lx PCR buffer, 2 mM MgCl 2 , 
0.2 \iM dNTP, 0.5x LC Green PLUS , 0.2 U ThermoTaq 
polymerase (Thermo Scientific), and 0.3 \iM FW and 
REV primer. The cycling and melting conditions were 
as follows: one cycle at 95°C for 15 min., followed by 
45 cycles of 95°C for 10 s, 63°C for 10 s, and 72°C for 
10 s. The sample was then melted by raising the 
temperature from 60°C to 95°C at a rate of 0.02 C/s. 
Mutations were analyzed using LightCycler Analysis 
Software 1.5.0 SP3 program (Roche Applied Science, 
Penzberg, Germany). 



Results 

Five genotyping methods for determining the status of 
mutation of KRAS were assessed using frozen tissue 
from primary NSCLC tumor specimens. 131 DNA sam- 
ples were analyzed with 4 of the methods (Direct se- 
quencing, K-ras StripAssay, TheraScreen DxS, and 
Pyrosequencing), and 116 of these were also analyzed 
using the High resolution melting (HRM) technique. In 
the absence of a gold standard, we adopted a consensus 
method for assigning each samples mutation status. The 
results obtained and methodology used are shown in 
Table 1. 

As expected, the percentage of the DNA samples in 
which mutations were detected varied (from 20% to 5%) 
depending on the method of detection used. The Kras- 
StripAssay had the highest likelihood of referring a mu- 
tation in the KRAS locus, followed by TheraScreen DxS, 
HRM, Pyrosequencing, and Direct sequencing (Table 2). 

However, on the basis of our evaluation criteria (Table 1), 
the most sensitive tool was the TheraScreen DxS kit 
(95%), followed by the K-ras StripAssay (90%), HRM 
(70%), Pyrosequencing (48%), and Sequencing (29%). The 
most specific tools were the TheraScreen DxS kit, Sequen- 
cing, and Pyrosequencing (100%), followed by HRM (98%) 
and the K-ras StripAssay (95%) (Table 3). 
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Figure 3 TheraScreen analysis of the KRAS gene in DNA isolated from NSCLC tissue. (A) Wild type. The figure shows a positive PCR control 
in which the quantity and quality of the DNA were assessed (red curve) without any other amplification of ARMS mutation positive primers 
(green curve) (B) Mutant. The figure shows a positive PCR control and a mutation signal (12Asp) generated by one tube of the ARMS-primers. 
The upper limit on AG, which corresponds to a mutant DNA content of 1%, is for the mutant PCR to be 8 cycles behind the control PCR (here 
ACt = 26.44 - 24.03 = 2.41). 



The number of false positives and false negatives 
obtained with each method would change if one were to 
change the interpretation criteria. For example, if the 
K-ras StripAssay is taken to be the gold standard, then 
the false positives detected by this method would be- 
come false negatives detected by the other methods. To 
eliminate this potential ambiguity, we performed more 
tests to assess and compare the sensitivity thresholds of 



the tested methods. We used three ATCC cell lines 
whose KRAS mutation statuses are known and 
recorded in the COSMIC database: A549 (p.Glyl2Ser), 
NCI-H620 (p.Glyl2Val), and NCI-H2009 (p.Glyl2Ala). 
We extracted sample DNA from the cell lines, measured 
its concentration by spectrophotometry, and then made 
dilution series of the DNA from the KRAS mutant cell 
lines in DNA from the NCI-H1975 KRAS wild-type cell 
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Figure 4 StripAssay analysis of the KRAS gene in DNA isolated from NSCLC tissue. (A) Wild typed 2Gly, 13Gly) (B) Mutant-(12Ala, 13Gly). 



line such that the mutant DNA comprised 25%, 20%, 
15%, 10%, 5%, 1%, 0.5%, 0.25%, or 0.125% of the total 
KRAS DNA (Figure 6). 

At a mutant minority of 1%, only TheraScreen and 
StripAssay were capable of detecting mutations in KRAS, 



while other methods have detection limit at 10% (Pyro- 
sequencing), and 25% (HRM and Sanger sequencing). 
Interestingly, in one technical replicate the mutation 
detected by the TheraScreen DxS kit in cell line A549 
(p.Glyl2Cys) was inconsistent with what was actually 
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Table 1 Summary of the genotyping results obtained with the five tested methods in 131 NSCLC samples 
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Wt 


Wt 


Wt 


12Arg 


Wt 


Wt 


25 


Wt 


Wt 


Wt 


12Val 


Wt 


Wt 


26 


Wt 


Wt 


Wt 


12Cys 


Wt 


Wt 


27 


Wt 


Wt 


Wt 


13Cys 


Wt 


Wt 


28 


Wt 


Wt 


Wt 


12Ala,13Cys 


Wt 


Wt 


29 


Wt 


Wt 


Wt 


12Ser 


Not tested 


Inconclusive 


30 


Wt 


Wt 


Wt 


12Ala 


Wt 


Wt 


31 


Wt 


Wt 


Wt 


Wt 


Mutation 


Wt 


32 


Wt 


Wt 


Wt 


Wt 


Mutation 


Wt 


33 - 131 


Wt (99 samples) 


Wt (99 samples) 


Wt (99 samples) 


Wt (99 samples) 


Wt (87 samples), 
1 1-no DNA template, 
1 -inconclusive sample. 


Wt 



The consensus result for a given sample was taken to be that obtained when the two CE-marked methods (K-ras StripAssay and TheraScreen DxS) were 
concordant with one-another (results that do not match this consensus are highlighted with a dark background). The detection of different types of mutation by 
different methods (e.g. in sample 3, p.Gly12Cys vs p.Glyl 2Val; in sample 16, p.Gly12Arg vs p.Gly13Cys; and in sample 18, p.Gly12Asp vs p.Gly13Asp) was not 
considered indicative of discrepancy because the precise identity of the mutation present is clinically irrelevant in this case (instances of type-of-mutation 
discordance are highlighted with a light background). In cases where the K-ras StripAssay and TheraScreen DxS kit generated inconsistent results, the sample was 
considered to be mutated only if one of the other three methods indicated the presence of a mutation. Thus, three samples (samples 20, 21, and 29) generated 
inconclusive results. Inconclusive results were excluded from further analysis. 



present. At a mutant minority of 0.5%, the TheraScreen 
DxS kit only detected mutation in the NCI-H620 cell 
line (p.Glyl2Val); the K-ras StripAssay failed to yield any 
positive results when analyzed using the StripAssay 



Evaluator software, but was judged to have correctly 
detected a mutation in the NCI-H620 line on the basis 
of visual inspection. At a mutant minority of 0.25%, only 
the K-ras StripAssay yielded a positive result. Remarkably, 
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Table 2 Number and percentage of mutations detected 
by methods 



Methods 


Mutations/ 
samples 


% 


Mutations/ 
samples 


% 


Direct sequencing 


6/131 


4.5 


6/116 


5.2 


Pyrosequencing 


10/131 


7.6 


10/116 


8.7 


HRM 






15/116 


13.1 


TheraScreen DxS 


20/131 


15.2 


17/116 


14.6 


K-ras StripAssay 


26/131 


19.8 


24/116 


20.7 



To allow comparison with HRM, results are provided not only for 131 but also 
for 116 samples. 



the K-ras StripAssay was able to detect the mutation in the 
NCI-H2009 line (p.Glyl2Ala) even at a mutant minority of 
0.125%. 



Discussion 

We have examined the ability of five different methods 
to detect mutations in the KRAS gene in 131 DNA sam- 
ples. KRAS mutations were detected in 21 samples 
(16.0%), 107 samples were found to contain wild-type 
DNA (81.7%), and three yielded inconclusive results 
(2.2%) (Table 1). Of the 21 samples in which mutation 
was detected by one or more methods, there were only 
four for which all five yielded a positive result (19.0%). 
Of the 95 wild-type samples analyzed by all five meth- 
ods, concordance was observed in 87 (91.6%); overall, 
the five methods were in agreement with one-another 
for 78% of the samples examined. Excluding HRM, the 
four remaining analytical methods all generated positive 
results for 4 out of 21 samples found to be positive by 
one or more method (4.4%) and all generated negative 
results for 101 of 107 samples found to be negative by 
one or more method (94.4%), giving an overall agree- 
ment of 82%. 

Our findings concerning the ability of these methods 
to detect mutations in KRAS are similar to those of 
Whitehall et al. (2009), who compared Dideoxy sequen- 
cing, HRM, the TIB Molbiol kit (Berlin, Germany), and 
the TheraScreen DxS (Manchester, UK) kit using DNA 
isolated from frozen colorectal cancer tissues. In their 
study, all five methods were found to be in concordance 
with regard to the KRAS mutation status of 66 of the 80 
samples tested (83% agreement) [20]. 



Both our results and those obtained by Whitehall [20] 
show that a significant number of samples from colorec- 
tal tumor and NSCLC contain mixtures of KRAS wild- 
type and KRAS mutant cells, and that in many cases the 
percentage of mutant cells is below the threshold that 
can be detected by direct sequencing. This inherent het- 
erogeneity of bioptic tumor tissues is an universal prob- 
lem, albeit one that can be partially addressed by 
concentrating the tumor cells (e.g. by laser capture 
microdissection) before extracting their DNA. However, 
the fact that even a pure sample of tumor cells may con- 
tain large quantities of wild-type KRAS further compli- 
cates the selective identification of mutations in this 
gene. Consequently, it is desirable that methods for 
detecting KRAS mutations should be highly sensitive, 
and this point should be borne in mind when selecting a 
proper diagnostic method. Our study identified the 
TheraScreen DxS kit as having the best ability to detect 
KRAS mutations in clinical samples, followed by the 
K-ras StripAssay (Table 4). 

Our results also indicate that direct sequencing is only 
of limited utility when trying to detect mutations in the 
KRAS gene in cancer tissues, since this method only 
detected KRAS mutations in 6 of the 131 DNA samples 
tested, even though 21 were found to contain mutations 
by other methods. Though direct sequencing is still being 
advocated as KRAS genotyping method of choice [21], it 
missed 72% of all mutations in our cohort. Obviously, the 
sensitivity of the sequencing methods could be further 
improved by using laser microdissection [22], preferential 
preamplification [23], inclusion of both primary and 
metastatic tissues in the analysis, or by using clamping to 
suppress PCR amplification of the wild-type gene [24]. 
However, we agree with Pinto et al that Sanger sequen- 
cing (without the first steps of COLD-PCR) [25] is 
currently outperformed by more sensitive techniques [26]. 

Pyrosequencing is easily capable of detecting PCR frag- 
ments that are 25-50 bp in length while longer fragments 
may pose a problem. However, this is not the case of 
detecting mutations in KRAS, because the most frequent 
mutations in this gene are adjacent, occurring in codons 
12 and 13. It may even be advantageous to use short frag- 
ments when diagnosing mutations because DNA may be 
fragmented during the processing of clinical tissue sam- 
ples. In accordance with results of others [27,28], Pyrose- 
quencing outperformed conventional sequencing for 



Table 3 False positive and false negative rates of the different methods 

Sequencing Pyrosequencing TheraScreen DxS K-ras StripAssay HRM 

(n=131) (n=131) (n=131) (n=131) (n=116) 

False positives 0/1 1 0 (0 %) 0/1 1 0 (0 %) 0/1 1 0 (0 %) 6/1 1 0 (5 %) 2/96 (2 %) 
(1 - specificity) 

False negatives 15/21 (71 %) 1 1/21 (52 %) 1/21 (5 %) 2/21 (10 %) 6/20 (30 %) 
(1 - sensitivity) 
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Figure 6 Comparative sensitivity analysis of KRAS typing kits in dilution series, where DNA from three mutated cell lines was diluted 
in wild-type DNA. Results of dilution series consisted of 25%, 20%, 15%, 10%, 5%, 1%, 0.5%, 0.25%, and 0.125% of mutated DNA in wild-type 
DNA. For threshold found in the first dilution experiment and one adjacent concentration from each side, typing was performed three times. 
Resulting consensus thresholds (found two or three times out of three repeats) for cell lines A549 (p.Gly12Ser), NCI-H620 (p.Glyl 2Val), and 
NCI-H209 (p.Glyl 2Ala) are shown in the graph. 



detecting KRAS mutations in samples with levels of 
mutant cells ranging from 5 to 25% (Table 4) while 
quantification of mutated portion of DNA was not pos- 
sible. This is probably due to preferential amplification 
of the mutated samples by the primers designed for the 
particular Biotage kit used. This shortcoming could be 
obviated by a better primer design or other modifica- 
tion of the kit and/or improvements in the interpret- 
ation algorithm [29,30]. Promisingly, a massively 
parallel pyrosequencing system using nanoliter reac- 
tion volumes has yielded satisfying results in an inter- 
laboratory comparison [28]. While this probably 
represents the future of testing in predictive oncology, 
such systems are prohibitively costly for most labora- 
tories at the present. 



HRM proved to be the least expensive and the most rapid 
method, as it requires only standard real-time PCR reagents 
and a slightly prolonged PCR protocol. Despite the optimis- 
tic references from other laboratories [31], the analysis of 
the melting profiles in our hands remains less reliable than 
other methods, and even repeated testing of our reference 
DNA did not always yield consistent results. Because of 
this, the typing of two samples by this method was incon- 
clusive. We may speculate with Do [32] that treatment of 
DNA with uracil glycosylase or special step of DNA clean- 
ing would help standardize the method and better its ana- 
lytical parameters. Interestingly, HRM analysis identified 
mutations in the KRAS locus of two DNA samples (samples 
31 and 32) for which none of the other methods detected 
any mutation (Table 1). In keeping with the findings of 



Table 4 Pairwise concordance between methods for KRAS mutation detection 







Direct sequencing 


TheraScreen DxS 


K-ras StripAssay 


Pyrosequencing 


HRM 


+ 




+ 




+ 




+ 


+ 


Direct sequencing 


+ 








0.338 




0.257 


0.735 


0.537 


TheraScreen DxS 


+ 


5 


15 








0.790 


0.555 


0.739 






1 


110 














K-ras StripAssay 


+ 


5 


21 


19 


7 






0.438 


0.500 






1 


104 


1 


104 










Pyrosequencing 


+ 


6 


4 


9 


1 


9 


1 




0.687 






0 


121 


11 


110 


17 


104 






HRM 


+ 


6 


9 


12 


3 


11 


4 


9 6 








0 


99 


4 


95 


12 


87 


1 98 





Every intersection of method row and method column corresponds to a 2x2 contingency table for two methods. The upper right part of the table is filled with k 
concordance metrics. 
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other authors [33], we interpret these results as reflecting a 
tendency of HRM to generate false positives. However, it is 
possible that they reflect rare mutations outside codon 12 
and 13 that destabilize heteroduplex DNA even in the pres- 
ence of an excess of wild-type DNA. Although cost and 
time efficiency are important factors in clinical diagnosis, 
the reproducibility of the HRM method will need to be 
improved before it can be considered viable. This could po- 
tentially be done by changing primers [34], adding melting 
standards [35], spiking with oligonucleotides [36], or com- 
bination with SNaPshot [37]. 

The StripAssay was the most analytically sensitive 
test (Table 2) of those we examined. On the basis of 
the results obtained with this method in the series 
of tests conducted with dilution series of mutant 
KRAS DNA (Figure 6), one could even argue that 
samples 24 to 30 should be reassigned as mutants 
(Table 2), thereby changing the false positive rate for 
the K-ras StripAssay to 0/128 and the false negative 
rate for TheraScreen DxS to 7/128. However, the in- 
terpretation of StripAssay results can be quite prob- 
lematic for samples whose mutant DNA content is 
below 1% (see the result obtained with a mutant mi- 
nority of 0.5% NCI-H620 in Figure 6). Insofar, it was 
not tested in clinical studies what is a significance of 
fraction of mutated cells below 1%, regardless of the 
typing method used. 

During time of submitting this article, company's soft- 
ware was upgraded to follow more precisely the require- 
ments of ISO 15 189 norm (scanner calibration standard 
was added and manual baseline correction feature was 



removed). It remains to be seen if such changes bring 
any improvement to diagnostic accuracy. 

Of the methods examined in this study, the TheraSc- 
reen DxS kit was the fastest method and exhibited the 
highest sensitivity and specificity. However, it was also 
the most expensive method that is not free of false reac- 
tions. Specifically, the kit failed to detect the p.Glyl3Cys 
mutation in sample 2 because it is not designed to detect 
this mutation. Although the frequency of the mutations 
that are not covered by the TheraScreen DxS test is very 
low and clinically not highly relevant, this nevertheless 
constitutes an inherent limitation of the kit. In addition, 
the precise allelic mutation detected by this kit in sam- 
ples 3, 16, and 18 differed from the consensus result. 
While this could potentially be due to stochastic vari- 
ation in the early events of PCR priming, there is no 
firm evidence to support this hypothesis. Although dis- 
crepancies in the precise identity of the mutation are not 
yet clinically relevant, and these results were not scored 
as errors in this study, this finding warrants caution 
when using the ARMS Scorpions assay in different diag- 
nostic setups, where the type of mutation is important 
(e.g. when looking at the T790M and S768I activating 
mutations in EGFR genotyping). As discussed above, 
samples 24 to 30 gave positive results in the StripAssay 
but were negative when analyzed with the TheraScreen 
DxS kit, and they seem to have a mutant population in 
the clinically "grey area," having less than 1% of the cells 
in the sample containing KRAS mutation. Ideally, their 
status should have been resolved by PCR amplicon clon- 
ing, followed by sequencing of the clones, digital PCR, 



Table 5 Summary of the properties of the different methods 





Sanger sequencing 


Pyrosequencing 


TheraScreen DxS 


StripAssay 


HRM 




CE mark 


no 


no 


yes 


yes 


no 


CE mark 


Limit of 
detection* 


25-30 %* 


5-10%* 


1 % 


below 1 % 


5-10%* 


Limit of 
detection* 


Turnaround 
time 


2-3 days 


2 days 


1/2 day 


1 day 


1/2 day 


Turnaround 
time 


Ease of 
interpretation 


easy 


easy 


easy 


medium 


difficult 


Ease of 
interpretation 


Technician 
time 


6 hrs 


4 hrs 


2 hrs 


5 hrs 


2 hrs 


Technician 
time 


Amount of 
input DNA 


1 reaction 


1 reaction 


8 reactions 


1 reaction 


1 reaction 


Amount of 
input DNA 


Detection 
of rare 
mutations 


Yes - can detect 
any mutation located 
between the primers. 


Yes - can detect any 
mutation within the short 
sequencing fragments. 


No - can only 
detect 7 specific 
mutations. 


No - can only 
detect 1 0 
specific 
mutations. 


Yes - can detect 
some mutations 
located between 
the primers. 


Detection 
of rare 
mutations 


Reagent cost 


20 € 


40 € 


120 € 


60 € 


4€ 


Reagent cost 


Special 

equipment 

required 


Sequencer 
70 000 € 


Pyrosequencer 
150 000 € 


Real time PCR cycler 
30 000 € 


PCR cycler 
7 500 € 


HRM Real time 
PCR cycler 
75 000 € 


Special 

equipment 

required 



* from reference of Tsiatis 26 and Ogino 27 . 
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or ultradeep sequencing. However, this approach is not 
practical for routine work and we did not have sufficient 
DNA to perform this experiment. Moreover, the low fre- 
quency of KRAS mutations in patient tumors have un- 
known clinical relevance, since all drug registration trials 
were performed using 1% of mutant KRAS cells as a low 
detection limit of the method. 

The properties of the different methods examined in this 
work are summarized in Table 5. 

We agree with Tsiatis et al. [27] that for research pur- 
poses more than one genotyping platform is necessary 
to reveal double mutations and to provide complemen- 
tary data. In clinical settings, the most readily accessible 
NSCLC sample type is needle or brush biopsy, which is 
examined cytologically while resected, or biopsied tumors 
processed by formaldehyde fixation and paraffin embed- 
ding (FFPE). Proportion of FFPE samples from all samples 
usually reflects the best local practice and experience. Un- 
fortunately, the FFPE process alters significantly the quality 
of DNA, and in many cases the DNA isolation from cy- 
tology smears yields higher quality albeit lower quantity of 
DNA. Very low quantity of available DNA isolated from 
cytological preparations was a major limiting factor in our 
comparative study, which we tried to overcome using fro- 
zen tissue from biobank, since it provides both high quality 
and quantity of DNA. Moreover, due to recent biobanking 
initiatives [38], we are more frequently facing situations, 
where the tumor molecular diagnostics is performed from 
frozen tissues. Of the 11 FFPE samples genotyped using 
both the StripAssay and TheraScreen, 5 samples could not 
be typed by at least one method, 2 samples were wildtype 
by both methods, 3 samples were mutant by both methods, 
and one sample was p.Glyl2Asp by TheraScreen and wild- 
type by StripAssay. From one point of view, it could be 
argued that our genotyping results obtained using frozen 
samples are transferable to genotyping of FFPE samples be- 
cause the mechanisms by which the methods work are not 
dependent on the nature of the input sample. On the other 
hand, it should be noted that improperly-performed paraf- 
fin embedding damages DNA and can favor methods that 
are more robust to variation in the amount and quality of 
the starting material (this would arguably disfavor TheraSc- 
reen because it requires eight PCR reactions whereas the 
other methods require only one equivalent reaction). It has 
been suggested that the issue of limited material for testing 
can be largely circumvented by using whole genome ampli- 
fication techniques [39,40], although the potentially biasing 
impact of the genome amplification techniques on low fre- 
quency somatic mutation genotyping is still not fully 
addressed. However, we suppose that our tests of kit 
performance on frozen tissue samples provide useful 
insights into their general utility and will be valuable 
for orchestrating genotyping efforts across molecular 
pathology laboratories. 



Conclusions 

The performance of five methods (Direct sequencing, Pyro- 
sequencing, High resolution melting analysis, the TheraSc- 
reen DxS kit, and the K-ras StripAssay) for detecting 
mutations in the KRAS gene was compared using DNA 
extracted from 131 frozen NSCLC samples. The TheraSc- 
reen DxS kit was found to be the most effective, followed 
by the StripAssay kit. However, because of the heterogen- 
eity of typical cancer tissue samples and the differences in 
the two methods' mechanisms of action, there are still un- 
satisfactory numbers of discrepancies between these two 
'best' methods, which failed to agree on 8 of the 131 speci- 
mens examined in this work. Nevertheless, our findings 
should facilitate the rational selection of methods for 
detecting mutations at the KRAS locus using heterogeneous 
clinical samples obtained from biopsies of cancer patients. 
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